Reduced rank regression in Bayesian FDA
نویسنده
چکیده
In functional data analysis (FDA) it is of interest to generalize techniques of multivariate analysis like canonical correlation analysis or regression to functions which are often observed with noise. In the proposed Bayesian approach to FDA two tools are combined: (i) a special Demmler-Reinsch like basis of interpolation splines to represent functions parsimoniously and exibly; (ii) latent variable models for probabilistic principal components analysis or canonical correlation analysis of the corresponding coe¢ cients. In this way partial curves and non-Gaussian measurement error schemes can be handled. Bayesian inference is based on a variational algorithm such that computations are straight forward and fast corresponding to an idea of FDA as a toolbox for explorative data analysis. The performance of the approach is illustrated with synthetic and real data sets. As detailed in the table of contents the paper has a vertical structure corresponding to topics in data analysis and de ning the sequence of chapters and a horizontal structure referring to the most important special cases of the proposed model: FCCA, functional regression, scalar prediction, classi cation. Within chapters the special cases are addressed in turn such that a reader interested only in a special application of the model may skip the other sections.
منابع مشابه
Eco 2009/31 Department of Economics Forecasting Large Datasets with Bayesian Reduced Rank Multivariate Models
The paper addresses the issue of forecasting a large set of variables using multivariate models. In particular, we propose three alternative reduced rank forecasting models and compare their predictive performance for US time series with the most promising existing alternatives, namely, factor models, large scale Bayesian VARs, and multivariate boosting. Speci cally, we focus on classical reduc...
متن کاملConditional posteriors for the reduced rank regression model
The multivariate reduced rank regression model plays an important role in econometrics. Examples include co-integration analysis and models with a factor structure. Geweke (1996) provided the foundations for a Bayesian analysis of this model. Unfortunately several of the full conditional posterior distributions, which forms the basis for constructing a Gibbs sampler for the poster distribution,...
متن کاملStochastic complexities of reduced rank regression in Bayesian estimation
Reduced rank regression extracts an essential information from examples of input-output pairs. It is understood as a three-layer neural network with linear hidden units. However, reduced rank approximation is a non-regular statistical model which has a degenerate Fisher information matrix. Its generalization error had been left unknown even in statistics. In this paper, we give the exact asympt...
متن کاملBayesian Information Sharing Between Noise And Regression Models Improves Prediction of Weak Effects
We consider the prediction of weak effects in a multiple-output regression setup, when covariates are expected to explain a small amount, less than ≈ 1%, of the variance of the target variables. To facilitate the prediction of the weak effects, we constrain our model structure by introducing a novel Bayesian approach of sharing information between the regression model and the noise model. Furth...
متن کاملBayesian sparse reduced rank multivariate regression
Many modern statistical problems can be cast in the framework of multivariate regression, where the main task is to make statistical inference for a possibly sparse and low-rank coefficient matrix. The low-rank structure in the coefficient matrix is of intrinsic multivariate nature, which, when combined with sparsity, can further lift dimension reduction, conduct variable selection, and facilit...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010